Web Survey Bibliography
Title The Use of SMS as a Research Tool
Author Cooke, M., Strong, C., Nielsen, A.
Year 2003
Access date 17.05.2004
Presentation ppt (877k)
Abstract We will explore the use of SMS as an advertising medium and a new data collection tool for survey research. We are undertaking an empirical piece of original survey research, which will be of both methodological and substantive interest to the audience. It will study the effectiveness of SMS text messaging as a potentially new “disruptive” communication and research medium. A “disruptive innovation” is one that creates an entirely new market though the introduction of a new kind of product or service. According to Christensen, a fatal threat to established companies’ market share could begin as a low-quality, low-margin product that your customers don't want and can't use - yet. A disruptive technology is a new product or service that is not necessarily as good as your current product line. Typically, it's technologically simple. Often, it's more convenient to use. It's something that's cheaper, simpler, and often smaller. SMS is certainly a simple advertising medium. It is limited to 160 text characters, has no sound or high quality visuals. But ignore these disruptive technologies, and they just may grow in capability to meet mainstream needs. SMS has done just that. It has revolutionised inter-personal communications. From being a way to exchange information between engineers it has revolutionised person-to-person communications and entertainment. Can it do the same for advertising and marketing research? The explosion in personal text message usage which has taken place in recent years has led to ripples of excitement amongst many researchers because of the new research opportunities it represents. The growth in texting has been dramatic, reaching near saturation in some demographic segments, with 80% of 18-24 year olds using mobile phones and over 90% of this group making use of text messaging. What started as a personal Consumer-to-Consumer pursuit is increasingly moving towards a commercial, Business to Consumer activity. One rapidly emerging area is text-based advertising, whereby third parties use the 160 characters available to communicate with their target market. This completely new advertising medium is a very exciting one in which a number of companies are competitively selling advertising inventory and FMCG brands are keen to explore the possibilities of the medium and understand how they can best use it to promote their brands effectively. To facilitate their inventory sales these new sales companies have had to build large databases of mobile phone owning individuals. These databases may contain detailed behavioural and demographic profiling information to allow precise targeting of their client’s advertising offerings. This in turn has created the possibility of a new research medium that allows surveys to be delivered by telephone to precisely targeted samples of the mobile population, with their own personal return path. The potential cost and time advantages are obvious. A number of the ASP companies are now actively marketing the research opportunities that these ‘panels’ offer for conducting market research. The emergence of this new channel poses both opportunities and challenges for researchers in terms of: 1. How effective is SMS text messaging as an advertising medium and how does one go about measuring the advertising impact of this medium? 2. Does the medium create new opportunities as a channel for research? We are conducting a three-stage research programme to answer these questions. Stage One explored the effectiveness of SMS text messaging as an advertising medium for reaching young adults. This was done, with the cooperation of the London Business School and The Mobile Channel, among young people who had given their permission to TMC to send them mobile advertising. The trial lasted six weeks and 35 brands participated. They represented a range of sectors, chosen to appeal to the young adult market. Six types of advertising were tested “Brand building advertisements”, “Special Offers”, “Teasers”, “Information requests”, “Competitions” and “Polling”. The research found that traditional advertising effectiveness measures worked well. The results suggest that with the right execution, SMS Text Messaging can create high levels of readership, advertising awareness, positive brand attitude shifts, and lead to high levels of direct response to the advertising message. It will be argued that the new medium has the potential to be a truly disruptive technology in the advertising arena. The mobile phone is, in principle, the ultimate medium for one-to-one interactive marketing – marketing as conversation. It is an intensely personal medium, which consumers have close to them at all times, and which they use for some of their most intimate conversations and messages. This gives it the potential to be a disruptive research medium as well as an advertising medium. In the second part of the paper we will explore the degree to which this is likely. Stage Two of our research programme therefore examines the degree to which mobile phone users, identified from more traditional research panels, are likely to cooperate with market research studies. Here the results were less encouraging. From a sample of 3,474 members of the NOP Online panel that had mobile phones with SMS capabilities only 19% granted us permission to send them surveys using SMS. While this was very similar to the percentage of our panel that is willing to take telephone studies from us (17%) it is five times worse than the cooperation levels we discovered for face to face interviewing (81%) and mail studies (77%). In the paper we will explore the reasons for this high level of non-cooperation and show how by addressing the key concerns of respondents researchers can achieve significant increases in co-operation rates. These were identified via an online qualitative research study to ascertain why such a high proportion of our panellists were reluctant to take surveys by SMS. Our initial findings are in line with the latest “2001 Respondent Cooperation & Industry Image Study” produced by The Council for Marketing & Opinion Research, which argued that consumers prefer Internet and mail surveys to the more intrusive telephone method. Our hypothesis is that the very strengths of SMS, its personal nature, precise targeting and portability, which make it such a powerful advertising medium, may actually work against it as a research medium. It is possible that our panellists see it as an intrusive method of contacting them and therefore one that they do not favour as a research medium. However, even if we argue that SMS is unlikely to be a uniquely “disruptive” research medium, it is possible that it can play a role in a multi-modal research design. In a world in which we want to encourage respondents to complete surveys by whatever mode is most convenient to them, it might be that there are certain research situations where we find that SMS has a role to play. For example a recent ESOMAR paper argued that it was a technique capable of measuring daily newspaper readership using SMS questions sent via a mobile telephone. In stage three of our research programme we will explore the types of research that can best be conducted using SMS. In the final paper we will report on the findings of the study that we will shortly conduct. This study will be an experimental design in which we will test the effects on SMS survey response rates of asking different types of questions, interview length, open-ended questions and incentives. The literature currently offers no advice on any of these areas. The paper will therefore make a major contribution to the literature on “wireless” as a communications & research medium and the degree to which it is likely to be a “disruptive” force in these two fields.
Access/Direct link Homepage - conference (abstract)
Year of publication2003
Bibliographic typeConferences, workshops, tutorials, presentations
Web survey bibliography - Mobile phone surveys (305)
- Measuring Subjective Health and Life Satisfaction with U.S. Hispanics; 2017; Lee, S.; Davis, R.
- Device and Internet Use among Spanish-dominant Hispanics: Implications for Web Survey Design and Testing...; 2017; Trejo, Y. A. G.; Schoua-Glusberg, A.
- How to Design a Web Survey Using Spring Boot With MYSQL: a Romanien Network Case Study; 2017; Bucea-Manea-Tonis, Ro.; Bucea-Manea-Tonis, Ra.
- Analyzing Survey Characteristics, Participation, and Evaluation Across 186 Surveys in an Online Opt-...; 2017; Revilla, M.
- Data chunking for mobile web: effects on data quality; 2017; Lugtig, P. J.; Toepoel, V.
- Mobile-only web survey respondents; 2016; Lugtig, P. J.; Toepoel, V.; Amin, A.
- Development and Pilot Test of a Mobile Application for Field Data Collection; 2016; Chiappetta, L.; Kerr, M. M.
- Are Initial Respondents Different from the Nonresponse Follow-Up Cases? A Study of Probability-Based...; 2016; Zeng, W.; Dennis, J. M.
- A Feasibility Study of Recruiting and Maintaining a Web Panel of People with Disabilities; 2016; Chandler, J.
- Why Do Web Surveys Take Longer on Smartphones?; 2016; Couper, M. P.; J. J.Peterson, G. J.
- Web surveys for offline rural communities ; 2016; Gichohi, B. W.
- Pre-Survey Text Messages (SMS) Improve Participation Rate in an Australian Mobile Telephone Survey:...; 2016; Dal Grande, E.; Chittleborough, C. R.; Campostrini, S.; Dollard, M.; Taylor, A. W.
- Short and Sweet? Length and Informative Content of Open-Ended Responses Using SMS as a Research Mode; 2016; Walsh, E.; Brinker, J. K.
- Collecting Data from mHealth Users via SMS Surveys: A Case Study in Kenya; 2016; Johnson, D.
- Online Surveys are Mixed-Device Surveys. Issues Associated with the Use of Different (Mobile) Devices...; 2016; Toepoel, V.; Lugtig, P. J.
- Using Mobile Phones for High-Frequency Data Collection; 2015; Azevedo, J. P.; Ballivian, A.; Durbin, W.
- Who Are the Internet Users, Mobile Internet Users, and Mobile-Mostly Internet Users?: Demographic Differences...; 2015; Antoun, C.
- Mobile Research Methods: Opportunities and challenges of mobile research methodologies. ; 2015; Toninelli, D. (Ed.); Pinter, R.; de Pedraza, P.
- Web Surveys Optimized for Smartphones: Are there Differences Between Computer and Smartphone Users?; 2015; Andreadis, I.
- Usability of the ACS Internet Instrument on Mobile Devices; 2015; Horwitz, R.
- GreenBook Research Industry Trends Report; 2015; Murphy, L. (Ed.)
- Emerging Technologies: The Rise of Mobile Devices: From Smartphones to Smart Surveys; 2015; Buskirk, T. D.
- PayPal? An Incentive to Check-out?; 2015; Franklin, J.; Rasmussen, C.; Pruitt, J.; Waller, D.
- Designing Bonsai Surveys: The small but perfectly formed survey experience to meet the needs of the...; 2015; Puleston, J.
- Open narrative questions in PC and smartphones: is the device playing a role?; 2015; Revilla, M.; Ochoa, C.
- Recruiting Respondents for a Mobile Phone Panel: The Impact of Recruitment Question Wording on Cooperation...; 2015; Busse, B.; Fuchs, M.
- Internet Research in Psychology; 2015; Gosling, S. D., Mason, W.
- Are Tailored Outreach Efforts Too Costly? An Assessment of a Responsive Design Approach to Control Costs...; 2015; Epps, S. R.; Getman, D. P.; Hall, L. M.; Hunter, J. A.
- Evaluating Visual Design Elements for Data Collection and Panelist Engagement; 2015; Christian, L. M.; Harm, D.; Langer Tesfaye, C.; Wells, T.
- Does the use of mobile devices (tablets and smartphones) affect survey quality and choice behaviour...; 2015; Liebe, U., Glenk, K., Oehlmann, M., Meyerhoff, J.
- When it comes to mobile respondent experience and data quality, survey design matters; 2014; Mitchell, N.
- The Changing Landscape of Technology and its Effect on Online Survey Data Collection; 2014; Mitchell, N.
- The need of and the demand for completing surveys on mobile devices; 2014; Toninelli, D., Revilla, M., Ochoa, C.
- Survey participation via mobile devices in a probability-based online-panel: Prevalence, determinants...; 2014; Poggio, T., Bosnjak, M., Weyandt, K.
- Keeping Surveys Valid, Reliable, and Useful: A Tutorial; 2014; Greenberg, M. R., Weiner, M. D.
- Improving Response Rates and Questionnaire Design for Mobile Web Surveys; 2014; de Bruijne, M., Wijnant, A.
- Does Survey Mode Still Matter? Findings from a 2010 Multi-Mode Comparison; 2014; Ansolabehere, S., Schaffner, B. F.
- Nonresponse and Mode Effects in Self- and Interviewer-Administered Surveys; 2014; Atkeson, L. R.; Adams, A. N.; Alvarez, M. R.
- Do Web surveys facilitate reporting less favourable opinions about law enforcement?; 2014; Boivin, R., Cordeau, G.
- Question Grouping and Matrices in Web Surveys: Using Response and Auxiliary Data to Examine Question...; 2014; Bilgen, I., Stern, M. J.
- The Grouping of Items in Mobile Web Surveys; 2014; Mavletova, A. M., Couper, M. P.
- Moving answers with the GyroScale: Using the mobile device’s gyroscope for market research purposes...; 2014; Luetters, H., Kraus, M., Westphal, D.
- Students First Choice – the influence of mobile mode on results; 2014; Maxl, E.
- Device Effects: How different screen sizes affect answer quality in online questionnaires; 2014; Fischer, B., Bernet, F.
- Moving towards mobile ready web panels; 2014; Wijnant, A., de Bruijne, M.
- Online mobile surveys in Italy: coverage and other methodological challenges; 2014; Poggio, T.
- Comparison of Three Modes for a Crime Victimization Survey; 2013; Laaksonen, S., Heiskanen, M.
- Understanding Society Innovation Panel Wave 5: results from methodological experiments; 2013; Auspurg, K., Burton, J., Cullinane, C., Delavande, A., Fumagalli, L., Iacovou, M., Jaeckle, A., Kaminska...
- A Comparison of Results from a Spanish and English Mail Survey: Effects of Instruction Placement on...; 2013; Wang, K., Sha, M.
- Intra-individual variation of extreme response style in mixed-mode panel studies; 2013; Aichholzer, J.